DOCUMENT RESUME 



ED 272 218 

AUTHOR 
TITLE 

PUB DATE 
MOTE 

PUB TYPE 



EDRS PRICE 
DESCRIPTORS 



IDENTIFIERS 



ABSTRACT 



IR 051 598 

Weaver-Meyers, Pat; Winters , Jim 

Changes in Facilities and Services and Their Effect 

on User Attitudes. 

[84] 

23p. 

Reports - Research/Technical (143) — 
Tests/Evaluation Instruments (160) 

MF01/PC01 Plus Postage. 

Academic Libraries; Attitude Measures; Higher 
Education; Library Automation; Library Circulation; 
♦Library Facilities; Library Research; 'Library 
Services; Library Surveys; Questionnaires; *User 
Satisfaction (Information); Use Studies 
♦University of Oklahoma 



A user attitude survey was conducted in the main 
library at the university of Oklahoma before and after the opening of 
a new library wing which effectively doubled the size of the main 
library. At the time of the opening of the new wing, the circulation 
department began using a new computer system for circulation of the 
general collection. The survey included questions concerning the new 
circulation services, the new building facilities, and the collection 
arrangement, and was administered in the last month of the spring 
semester before the new wing was opened and in the last month of the 
following fall semester. Approximately 250 questionnaires were 
distributed each time. A return rate of 901 was achieved the first 
semester and 67% the second semester. Although changes in the 
facilities and services were dramatic, general user satisfaction did 
not appear to be affected. However, changes in users' opinions about 
some specific services were noted. High user expectations, a 
nonspecific survey construction, and multiple-service changes are 
discussed as some of the possible reasons for a lack of detectable 
change in overall satisfaction. The library survey and a 12-item 
bibliography are included. (Author/THC) 
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ABSTRACT 

A oser attitude survey was conducted in the main library at 
the University of Oklahoma pre- and post- the opening of a 
nev wing. The survey included questions concerning new cir- 
culation services, as well as queries about the new building 
facilities and collection arrangement. Although changes in 
the facilities and services were dramatic, general user sat- 
isfaction did not appear to be affected. However, changes 
in users* ^pinions about sone specific services were noted. 
High user expectations, nonspecific survey construction, and 
nulti pie-service changes are discussed as some of the possi- 
ble reasons for a lack of detectable change in overall sat- 



isfaction. 
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User frustration or user satisfaction has been the sub- 
ject of a number of studies by librarians in recent years. 
A common perforaance measure has been to determine patron 
frustration by measuring the retrieval success, or, book 
availability (Kantor, 1976;Saracevic, et al, 1977;Binkel 6 
HcCandless, 1983) . Attitude surveys have also been complet- 
ed in an attempt to determine the guality of service. Boss, 
for example, surveyed the attitude of student library users 
and found students most concerned about study space and book 
stock adequacy (noss 8 Green, 1980). Prohmberg has perh&ps 
solved the guandary of which methodology is best by combin- 
ing the tvo. It is noteworthy that in so doing, Frohmberg 
has -been -able -to demonstrate that an objectively measured 
change in availability, under -the circumstances described, 
vas accompanied by a change in user attitude (Frohmberg 8 
floffett, ?1981)- Line, however, found little measurable 
change in .attitude due to changes in services provided (Line 

C. Tidaarsh, .1966) ► 

Hore recently, D'Elia concluded that user behavior is en- 
igmatic and maybe too complex to gauge library perforaance 
except for analysis of specific services (D»£lia 8 Halsh 
1983). Chwe (1978) suggests a model which solves that prob- 
lem by having the patron rate the importance of the service 
to them in addition to determining their opinion of the 
guality of the service. 



Although not consistently demonstrated in attitude sur- 
veys to date, it seems logical to presume that dramatic 
changes in services and facilities should measurably affect 
patron 1 s perceptions about the library. Attitudes are com- 
plex and the relationship between changes in facilities and 
changes in such perceptions may not be consistent. Orr 
{1973) proposes that the "goodness of library service" can 
be.shovn by increased utilization of a service, since utili- 
zation tends to increase as capability does. He -does cau- 
tion that this relationship may not be directly proportion- 
al. Prom this and Frohmberg's results, one might conclude 
that a change in attitude may accompany a change in use. 

Regardless of the difficulty inherent in determining pa- 
tron perceptions, continued research in this area is inpor- 
tant to providing desirable services. Attitude surveys are 
just one of many marketing techniques that aight prove use- 
ful -to libraries interested in determining what services -are 
desired and then "selling" them to their clientele. 

In the summer of 1982, the University of Oklahoma Librar- 
ies completed and opened a new wing which effectively 
doubled the size of the main library and rerouted flow to 
and within the building. At the same time, the circulation 
department began circulation of the general collection on a 
new computer system, DataPhase AliS II. These changes sig- 
nificantly altered the environment and service desk interac- 
tions most patrons encountered. In an attempt to measure 



the change in attitude which these new facilities and servi- 
ces extolled from users, a survey vas conducted. 

The results of the survey suggest an instruanent for user 
satisfaction the Key elenents of vhich are: rating the im- 
portance of a service to the user, as well as assessing 
their opinion about service guality, inquiring afcont specif- 
ic services or facilities, gauging user expectations for im- 
provenent, and averaging both positive and negative reac- 
tions to provide an overall measure of satisfaction. 
Hethods for incorporating all these concepts into, a survey 
form are discussed. 

HETRODOLOGT 

Frohmberg's study on the impact of computerization of 
circulation procedures served, in part, as a basic reference 
for the construction of the attitude survey (see figure 1) 
distributed to users by circulation desk personnel . (insert 
figure 1) The survey vas administered in the last month of 
the spring semester before the new wing was opened and in 
the last month of the following fall semester. The last 
month of each semester was chosen to insure that the type of 
use and degree of business was similar in each situation. 

Approximately 250 questionnaires were distributed each 
time. In the first distribution, users were handed the 
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questionnaire as tbey exited and most stopped to fill it in 
as their materials were charged, which accounts for the high 
return rate of 90 percent. The following semester patrons 
were again surveyed upon leaving the facilities, but the 
desk orientation was altered, and many simply exited before 
completing the form. Therefore, only 167 surveys were re- 
turned, for a response rate of 67 percent. 

It is important to note that those surveyed, for whatever 
reasons, were library users. As in some surveys,, they were 
not. part of .the potential user population, but a sampling of 
the actual user population. Therefore, they presumably had 
an opinion of the library based on their use of it - not 
from hearsay. Also, the two survey samples are different. 
No effort was made to find the same patrons and compare 
their particular change in attitude. 

Once the surveys were administered, SAS statistical pack- 
age was used to compute Chi-square statistics in two-way ta- 
bles, which provided the obtained frequency, expected fre- 
quency and Chi-square values for each response possible 
comparing pre-new building answers with post-new building 
answers. The Chi-square values for each question in the 
survey are contained in Table I. (Insert Table I) 

Question number ten asked the patron how difficult the 
library's floor arrangement was to understand and is a good 
example to review initially. The floor arrangement was con- 
siderably altered during the move. In Table II, a contin- 
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gency table for question number ten, the total responses for 
each column (possible answer) are totaled, (insert Table II) 
An examination of the post-move survey results shows a high- 
er than expected response frequency for answer number one. 
It appears then, that the change in arrangement brought 
about daring the move did apparently affect those surveyed. 
The overall probability and total cfai-sguare for thet ques- 
tion are listed ia Table I. Since the probability is .0051, 
and our determination of significance for the purposes of 
this analysis vill be concluded at .05, then it follows that 
the total difference for all possible choices in question 
ten pre vs. post-move is significant. A close examination 
of. all the cells in Table II reveals the greatest changes 
appear in the 'easy to understand' and 'hard to understand' 
columns. It appears therefore, that the general population 
of library users' opinions about the library arrangement 
have improved considerably. The first group of respondents 
most often found the collection arrangement "hard to under- 
stand" while the second group's opinion most frequently fell 
into the "easy to understand" category - a shift of response 
that jumped over the "understandable" category. 

Question five represents the most dramatic change indi- 
cated. This is not surprising, since it addresses seating 
capacity. This coincides with floss's findings that study 
space is an important concern to students (floss & Green, 
1980) . The other question which addresses study space 



availability is question number eight, which shows a small 
bat significant improvement. 

In question four, patrons were found to be significantly 
■ore delayed in circulation desk service. This finding ac- 
tually confirms Frohmberg f s results. Frohmberg demonstrated 
that upon implementation of a nev circulation system, frus- 
tration increases due to the large amount of materials which 
must be loaded into the system at the time of check-out 
(Frohmberg 6 floffett, 1981 p. 86). Although this survey did 
not follow-up attitudes about circulation desk interactions 
later on, the fact that it initially supports Frohmberg f s 
findings leaves us with the opinion that satisfaction again 
TOS3 as the number of books coded rose, mioicing Frohmberg 1 s 
situation. kn examination of use statistics bears out this 
assumption. Circulation decreased about 10% the first year 
the new systea was in operation and have since risen 12X- 
Again, Prohmberg's findings of an increase in in-house use 
are confirmed as in-house use of naterials post-new circula- 
tion system in this situation was up 33%. »hat is notewor- 
thy here is that the increase in in-house use was initially 
attributed to the new building facilities. However, in 
light of Frohmberg's findings, it appears that it nay be re- 
lated to the implementation of the computer system, at least 
in part. 

The remaining questions demonstrated no significant 
change in opinion. It is interesting to note that there are 
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three categories covered: frequency of use (questions 2 G 
9) , perceived availability (questions 3 5 7), and overall 
satisfaction (questions 11 & 12). In review, no real change 
was aade in availability, and following Frohmberg's asser- 
tion that a change in state is reflected in a change in at- 
titude, no change should be the result. However, Frohmbera 
did point out that availability did change in their study 
due to decreased discharge time and increased stack mainte- 
nance (Prohaberg & Hoffett, 1981 p. 71). Informally/ it ap- 
pears that the same effect has been noted at University Li- 
braries, but that improveaent was not felt until the old 
manual system had been completely cleared of charges, which 
took from six months to one year to complete. Therefore, 
availability was not ia proved until after this survej was 
administered. 

Frequency of use and overall satisfaction are perhaps the 
most curious in their lack of significant change. Apparent- 
ly, users did not stay any longer in the facility than they 
had previous to the new addition. There was a five percent 
increase in the number of people entering the building. As 
stated earlier, the in-house use of materials increased 
thirty-three percent during the saae time period. This 
points to a dramatic change in what users did during their 
time in the building. Specifically, users were much more 
involved in using library materials, not just studying or 
socializing. It must be that patrons found the collection 
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easier to use, a conclusion snpported by the results of 
guestion 10. Hence, it appears that a change in the ease of 
use stimulates a change in the actual use of materials, but 
has no measurable effects, under the conditions of this 
study, in the frequency of library visitation. Since there 
vas a fire percent increase in the number of patrons coming 
to the facility, we choose to interpret some of the eleva- 
tion of materials 1 use to "new patrons". 

DI SC0SSIOS 

Some possible explanations for the lack of change in overall 
satisfaction should be forwarded at this point. In addi- 
tion, we will look at ways our survey form could have been 
improved to provide a better measure of satisfaction. There 
are several possible ways to explain the lack of change in 
satisfaction. They are: 

1) k change in facilities and/or services has no effect on 
the overall satisfaction level. 

2) A change in satisfaction may only be detected if the at- 
titude relates to a specific service that is specifically 
gueried. 

3) Changes may not necessarily be considered improvements 
or degradations to service thereby contributing no change to 
the overall level of satisfaction. 
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0) Hany patrons nay not avail thenselves of specific 
services and therefore may not be affected by a change in 
those services. 

5) Bhen many services or facilities are changed both in- 
proved and reduced service may be perceived. As a result, 
the overall satisfaction may appear unchanged due to the 
■oderating effect both positive and negative changes may 
have on general attitude. 

6) Unrealistic expectations for new services and fac .lities 
■ay make improvements appear less significant, thereby re- 
vealing no change in overall satisfaction. 

7) The survey instrument used vas not a valid measure of 
satisfaction or sample design was inadequate. 

8) The change in facilities and services required the pa- 
tron to to learn new things, thereby stimulating a resis- 
tance to the change which could affect attftude. 

9) Judgements about the wisdom of appropriate resource al- 
location in the university community might negatively pre- 
dispose some users to new facilities. 

Based on the research reviewed earlier, is there suffi- 
cient empirical evidence to conclude that possibility number 
one can be disregarded? The evidence is somewhat contradic- 
tory. D'Elia suggests that user opinion maybe too complex 
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to measure accurately. Frohaberg states that quantitative 
changes are accompanied by changes in attitudes. The answer 
is probably somewhere in-between and relates to the second 
explanation - that attitude or opinion about specifics are 
the only measurable results. This is somewhat confirmed by 
our inability to formulate a multivariate model to predict 
outcome. This was attc pted using discriminate analysis, 
factor analysis, and durmy regression (Barker & Barker^ 
1984). we may not have measured enough variables, which 
suggests increased complexity. It may be though, that the 
kind of interaction between user's opinions about various 
services could not be adequately weighted by this instru- 
ment. That problem can be solved by Chwe's rating of the 
importance of a service at the same time the user rates the 
quality of the service. 

The definite change found in perceptions of available 
study space l^nds credence to this explanation and under- 
scores the need for specific measures. Mot only did ques- 
tion 5 address a specific service, but it was a service that 
had been demonstrated in past attitude survey's to be of in- 
terest to students (a major proportion of the users sur- 
veyed) . The explanation of the results has implications for 
the construction of future questionnaires. If only those 
changes that are of special interests to users are affected, 
then even dramatic changes in facilities may not necessarily 
result in any change in user perceptions. In this case, a 
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substantial increase in book storage space may be of signif- 
icant interest to library staff, but may not be to library 
users. 

An example of the type of survey question which weights 
and quantifies opinion as suggested by Chwe could be: 

1) On a scale of 1 to 10 (1=poor and I0=superior) rate 
your feelings about the speed of service at the circulation 
desk. 

2) Generally, how often do you inguire at the circulation 
desk to check out a book, find or:t if something you are 
looking for is checked out, etc. a) once a day b) once a 
week c) once a month b) once every two months d) once a 
semester e) once a year 

Addressing such guestious to a specific service can show im- 
provement or deterioration in quality (when comparing before 
and after surveys). 

Points 3, « and 5 are also coveted by this kind of gues- 
tioni.jg. If a patron only uses a service once a year, their 
rating of its guality takes on less importance and a formula 
can be devised which quantitatively underscores the effect 
this particular service has on a "general satisfaction le*.- 
el" (see Chwe for formula suggestion). Such priority rat- 
ings :an then be compiled to produce a model that takes into 
account the moderating effect of positive or negative chang- 
es of several different services - each of varying value to 
the patron. 
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Another explanation for the lack of change in overall 
satisfaction relates to the potential change in expectations 
that a nev facility nay generate, point 6. A nev facility's 
simultaneous occurence with other service changes probably 
increases patror's expectations disproportionately. These 
high expectations nay make it difficult to impress the pa- 
tron with improved services. They nay sinply remain satis- 
fied, or may even feel disappointment, if their expectations 
were unrealized. A poll taken as users entered the library 
could provide a measure of expectations and this information 
could be correlated with the exit attitude s»r»ev. It would 
probably be advisable to include a question about the suc- 
cess of that particular visit and compare this also with the 
expectations. 

Any of these points could account for the lack of signif- 
icant change in general satisfaction. The survey instru- 
ment, though, lacks the measure of a service's importance to 
the patron, which would help to identify which service 
changes had the most influence. This, however, does not in- 
validate the survey form, as point 7 suggests. There is 
some support for validity in the tact that it confirms 
Frchabery's findinc^^ abou* . lrculation service and Moss's 
assertions about stuoy space. Also, the results obtained 
agree with D'Elia's findings which showed no change in sat- 
isfaction, forcing him to conclude that attitudes night be 
too complex to reliably generalize- 




The effect of resistance to the change forced on the user 
by new facilities is a difficult phenomena to weigh in im- 
portance. Innovation theory (Rogers, 1983 p. 24«) points 
out that adoption of an innovation or learning of a new 
skill follows a normal curve. As a result, the easiest way 
to allow for resistance, may be to delay the second sampling 
until peer networks communicate the value or lack of value 
inherent in the new facility. Then, the attitude sampled 
should no longer be clouded by feelings of resistance. 

Finally, in any community where limited resources cause 
competition for dollars, some resentment results from the 
funding of most projects. A delay in the second sampling 
could also allow time for these feelings to defuse. 

Although the thoughts above indicate there are many ways 
this survey could be improved, it should not be forgotten 
that the results do have significance to management for two 
reasons: 

1) They demonstrate that the change in facilities and ser- 
vices showed no detrimental effect on overall satisfaction. 

2) when compared to circulation services slowdown, the 
static satisfaction revealed that patrons were apparently 
willing to endure the slowdown with some eguanimity. 
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These are applicable results which affirm that no disastrous 
or negative results caae frca the changes and that patrons' 
good opinions will bear up under sone temporarily burdensome 
alterations in service. 

Conclusion 

-Deter pi uing user satisfaction with library services in gen- 
eral should be formulated from data about specific services, 
reelings for specific services should be placed in priority 
order based on the user's dependence on the service in their 
library visits. An average of the weighted services, it is 
suggested, will provide a measure of satisfaction which can 
be compared to general responses to overall satisfaction. 
This is a summary of a model suggested by this survey and 
the research of others. In addition, measuring change in 
attitude should include some measure of expectations to al- 
low for their effect on user opinion, and might also be de- 
layed in the second sampling to reduce feelings of resis- 
tance, etc. 

The survey in this study did not test this model theory, 
but rather provided the evidence necessary to reinforce the 
suggestions of Chwe, D'Elia, and Frohmberg. It was the lack 
of measurable change in overall satisfaction that forced a 
reappraisal of the instrument and the contributing factors 
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in a complete model to assess satisfaction. Despite the 
difficulties, pursuit of overall satisfaction continues to 
be necessary part of any instruaent measuring satisfaction. 
It pro tides the user an opportunity to comaent if a particu- 
lar service/facility is not included in other parts of the 
instrument, arid it is a check for negative attitude changes 
that may not be evident in separate guestions about individ- 
ual services. 

- In light of current marketing strategies for. libraries, 
it seems most appropriate to survey users and determine 
their needs and interests in both services and facilities- 
According to Daniel Carroll (1962), 

Harketing also seeks to identify would-be users 
whose utilization patterns are underdeveloped, for 
whatever reasons, and again to construct service 
arrangements/ that can relieve what has been re- 
duced or nonexistent usage. 

If Carroll is right, results from such surveys could assist 
managers in determining what services/facilities would most 
improve use. Also, considering the costs of circulating ma- 
terials and competition with home subscription of online 
services, strong arguments can be forwarded to support fa- 
cilities or services which encourage in-house use and user 
comfort. 

The final problem lies in correctly identifying user de- 
sires and weighing them against possible solutions. The use 
of an attitude survey in this circumstance has reinforced 
the findings of others and points to some specific concerns 
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patrons deem important. The value of attitude surveys will 
really only be completely demonstrated when more have been 
administered and contributing factors can be isolated and 
rated; thereby completing a weighted picture of which servi- 
ces or facilities most affect user opinion. 

Any effective overall performance measure should include 
a qualitative component. The model suggested here might 
fill that role and help determine if quantitative service 
changes actually result in measurable changes in patron per- 
cept! ons. 
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LIBRARY SURVEY 

-1 . Please circle your status. Freshman Sophomore Junior Senior 

Grad Faculty Other 

2. How often do you generally use the Main Library? (check one) 

More than once a week 

Once a week 

Once a month 

Once a semester 

Almost never 



3. The last time you looked for a book in the Main Library, were you able to 
locate it? . y es no 

4. How often have you been frustrated b" delays in service when checking out 
library materials? (circle one) 

1) Seldom or never 2) Occasionally 3) Often 4) Very frequently 
(i 

5. In your opinion, is there adequate seating space in the library? 

yes no 

6. Have you ever placed a hold on a book that was checked out by another 
patron? yes no 

7 . If you were to rate your chances of finding the books you need when you 
come to the library, what would they be? 

8. Almost never Half the time Almost always 



0 10 20 '30 40 50 60 70 80 90 100 

8. When you usually come to the library, how often are you able to find a 
quiet place to study? (excluding construction noises) 

1) Seldom or never 2) Occasionally 3) Often 4) Very frequently 

9. About how many hours were you physically present in the Main Library 
during the past three days? 

10. When you are looking for books, is the floor by floor arrangement of the 
collection: 

1) Easy to understand 3) Difficult to understand 

2) Understandable 4) Impossible to understand 

11. To what extent are you satisfied with library services? 

1) Very satisfied 3) Sometimes satisfied 

2) Usually satisfied 4) Seldom or never satisfied 

12. In your opinion, how do most other students feel about library services? 

1) Very satisfied 3) Sometimes satisfied 

2) Usually satisfied 4) Seldom or never satisfied 

(Questions 3, 4, 7, 9, 11, and 12 are taken or adapted with permission from a 

copyright instrument designed by Tantalus, Inc. for the Oberlxn College 
Libraries) 

ERJC Figure 1 



TABLE I 

CHI-SQUARE & PROBABILITIES OF SURVEY QUESTIONS 



Question Chi-square Degrees of Freedom Significance 

2 (Use) 6.591 4 n. s. 

3. (Locating Lost Book) 3. 082 1 n ' n f* 

4 (Frustration) 10,672 3 .01 

5 (Seating) 39.317 1 -0001 

6 (Holds) 2.893 1 n - s - 

7 (Finding Books) 11.467 11 n - «• 

8 (Quiet Place) 8.224 3 -04 

9 (Hours Present) 21.070 13 n. s. 
10 (Arrangement) 12.452 3 -00b 
11; (Own Satisfaction) 2.647 3 n. s. 
12 (Other Satisfaction) .408 3 n. s. 
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TABLE II 
QUESTION TEN CONTINGENCY TABLE 



Frequencies Easy to 
understand 


Understand- 
able 


Hard to 
understand 


Impossible 
to understand 


Pre-Move Freq 


49 


94 


70 


10 


Expected Freq 


62.0 


91.3 


58. 0 


9.8 


Post-Move Freq 


59 


65 


31 


7 


Expected Freq 


46.0 


67.7 


43.0 


7.7 


Chi-square = 
probability 


= 12.452, 
= .006 


3 degrees of 


freedom 
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